Goto

Collaborating Authors

 bandit phase retrieval






Bandit Phase Retrieval

Neural Information Processing Systems

We study a bandit version of phase retrieval where the learner chooses actions (A_t)_{t 1} n in the d -dimensional unit ball and the expected reward is \langle A_t, \theta_\star \rangle 2 with \theta_\star \in \mathbb R d an unknown parameter vector. We prove an upper bound on the minimax cumulative regret in this problem of \smash{\tilde \Theta(d \sqrt{n})}, which matches known lower bounds up to logarithmic factors and improves on the best known upper bound by a factor of \smash{\sqrt{d}} . We also show that the minimax simple regret is \smash{\tilde \Theta(d / \sqrt{n})} and that this is only achievable by an adaptive algorithm. Our analysis shows that an apparently convincing heuristic for guessing lower bounds can be misleading and that uniform bounds on the information ratio for information-directed sampling (Russo and Van Roy, 2014) are not sufficient for optimal regret.


Bandit Phase Retrieval

Lattimore, Tor, Hao, Botao

arXiv.org Machine Learning

We study a bandit version of phase retrieval where the learner chooses actions $(A_t)_{t=1}^n$ in the $d$-dimensional unit ball and the expected reward is $\langle A_t, \theta_\star\rangle^2$ where $\theta_\star \in \mathbb R^d$ is an unknown parameter vector. We prove that the minimax cumulative regret in this problem is $\smash{\tilde \Theta(d \sqrt{n})}$, which improves on the best known bounds by a factor of $\smash{\sqrt{d}}$. We also show that the minimax simple regret is $\smash{\tilde \Theta(d / \sqrt{n})}$ and that this is only achievable by an adaptive algorithm. Our analysis shows that an apparently convincing heuristic for guessing lower bounds can be misleading and that uniform bounds on the information ratio for information-directed sampling are not sufficient for optimal regret.